Search AI Products and News

With the continuous progress of artificial intelligence technology, multimodal data processing has gradually become a popular topic. Recently, the globally renowned electrical appliances brand Panasonic launched its latest R&D multimodal large model — OmniFlow. This model can efficiently convert between multiple modalities such as text, image, and audio, achieving any-to-any generation tasks, providing users with a more flexible experience. The design concept of OmniFlow is based on modularity, allowing the various components of the model to be independently pre-trained. This approach not only improves training efficiency but also avoids...

Recently, the Speech Team of Qwen Laboratory has made a milestone achievement in the field of spatial audio generation and launched the OmniAudio technology. This technology can directly generate FOA (First-order Ambisonics) audio from 360-degree videos, bringing new possibilities to virtual reality and immersive entertainment. Spatial audio, as a technology that simulates real auditory environments, can enhance immersive experiences. However, existing technologies are mostly based on fixed perspective videos and underutilize the spatial information of 360-degree panoramic videos. Traditional video-to-audio generation

Recently, Qwen released CoGenAV, innovating speech recognition technology with the concept of audio-visual synchronization. It effectively addresses the challenge of noise interference in speech recognition. Traditional speech recognition performs poorly in noisy environments, while CoGenAV takes a different approach by learning the temporal alignment relationships among audio-visual-text, building a more robust and generalizable speech representation framework, systematically improving tasks such as speech recognition (VSR/AVSR), speech reconstruction (AVSS/AVSE), and audio-visual synchronization (A').

The Vidu Q1 series models released this time have significantly enhanced video generation capabilities. In terms of image-to-video conversion, it can quickly generate creative and relevant video content based on user-provided images, giving images dynamic life; the beginning-and-end frame function allows users to precisely control the starting and ending frames of the video, making the video presentation more perfect.

Adobe has released a major update to its Firefly AI platform, expanding its capabilities to encompass image, video, and audio creation. This powerful new engine offers a comprehensive suite of tools for creative professionals.

Moonshot AI recently announced the launch of Kimi-Audio, a new open-source audio foundation model aimed at advancing the field of audio understanding, generation, and interaction. This release has garnered significant attention from the global AI community and is considered a major milestone in the development of multimodal AI. This report provides a comprehensive overview of Kimi-Audio's core features, performance, and industry impact. Breakthrough Features: Versatile Audio Processing Capabilities Kimi-Audio-7B-Instruct based on Qwen